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ABSTBACT 

The evaluation report is one of seven produced for 
the Occupational Exploration Prograa (OEP) , a series of simulated 
occupational experiences designed for junior high school students* 
Describing the pilot testing of the simulation dealing vith 
■anufacturing production, the report contains sections describing the 
siaalation context, evaluation procedures, results, and a Beviser*s 
Inforaation Suaaary (BIS) • In the simulation, students set up and put 
into operation a 38-step asseably line producing extension speakers 
for transistor radios. Safety rules, administrative procedures, and 
job training vere introduced* Occupational roles included supervisory 
positions and asseably line production* The experimental design 
involved tvo Colorado schools, vith a total of four experiaental and 
four control groups involving 77 eighth and ninth graders* 
Instruaentation included knowledge and affective testing, student and 
teacher questionnaires, and a panel review* Analysis of variance and 
other descriptive statistics vere esployed and reliability estimates 
vere calculated* Analysis of variance results revealed that the 
siaulation did not have a positive iapact on student occupational 
knovledge but did have soae positive iapact on student occupational 
preferences* The BIS records and extrapolates trends related to the 
strengths, veaknesses, and recoaaendations frpa all data sources* 
Appended aaterials include the evaluation instruaents used and a 
teacher evaluation log* (HH) 
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ABSTRACT 



MAI-rUFACTURDIG PRODUCTION ' • ■ ' 

g/ALUASION REPORT FOR Tffi 0CCUPATIOri.\L EXPLOFATION PROGRAJ-I 
By: James W. AltschuLd; Sandra Eritz; Janice Lave; Roberta Shively 



This renort is one of seven evaluation reports produced for the Occupational 
Ejcoloration Program. The Occupational Exploration Program (O.E.P.) is 
fimded "by the National Institute of Education and is a joint development 
effort of The Center for Vocational Education (The Ohio State University) 
and thO-„Jefferson County, Colorado public schools. O.E.P; is a series of 
experiences designed to provide junior high school students -vath the 
orjportunity to e:q)lore occtqoations . One of the major vehicles for explo- 
ration is the sim-olation technique. In "FY' 197*^, 12 simulations \:eve 
developed and seven of those tvrelve were pilot tested. This report de- 
scribes the pilot testing of the simulation dealing \d.th manufacturing. 
The rijport contains sections describing simulation context, evalmtion pro- 
cedtires, results and a Revisor's Information Summaxy (RIS). The RIS is 
useful for a variety of purposes and includes the strengths of the simulation 
as veil as its wealoiesses. Below is a synopsis of the specific content of 
this report. 

SP KHATIOIT COIiTEXT ; In this simulation, students experience various manu- 
facturing occupations. An assembly line requiring thirty-eight steps is 
set up and put into operation by participants. The students are introduced 
to safety rules, adiainistrative procedures, a job training program, and a 
production line. As a result of their participation, the students produce 
extension speakers that may be attached to transistor radios. The occupa- 
tional roles include planb superintendent, production supervisor, production 
coordinator, quality control supervisor, maintenance sttpervisor, and 
assembly line ^.orlcers. gCPERE-SIiTAL DESIGN ; For evaluating this simulation, 
t\ro schools, one in Jefferson County, Colorado and one in Denver, Colorado 
vere used, each school having tvro experimental and two control groups. ^ 
teacher facilitated the implenentation of the simulation ^d.th each experi- 
mental group. The experimental and control groups consisted of oth and 
9th graders: the four e:cperimental groups totaled 50 stuuents and the four 
control gx'cups totaled 27 students. A modified laboratory °^4^f.^^; 
experimental setting vras utilized for the product tryout. n^aiRWrTATIOrl. 
A 35 ite-3 multiple choice knowledge test, '^VHiat Do You Know?' , and a 5 
item affective test, -VJhat Do You Like?", were administered as pre- and 
posttest measures of student occupational knowledge gain and attitudinai 
change. The student post module questionnaire, '-l-mat Do You Thinlv? , ad- 
ministered to the experimental groixp after completion of the simulation, 
measured student perceptions of the module. Teacher questionnaires and a 
panel re'/iew were used for the piuDOse of obtaining teacher perceptions of 
the simulation. AliALYSK: The loaowledge test and affective test results 
vers derived thron-:i analyses of -/ariance. Other descriptive statisoics 
were employed where appropriate (i.e., frequency, percentage). Reliaoility 
estimates were calcu:.ated to obtain the internal consistency estimates of 
the laiw^edge test and to detei-ndne inter-coder and intra-coder agreement 



for the attitude scale* RE3UI/CS ; The AIIOVA results reveal that the siimila- 
tion did not have a positive impact on student occupational kno^fledge* 
However, nearly statistically significant (p_C06) changes in 'student occupa- 
tional preferences occurred* There vas almost unanimous response fron st\i- 
dent questionnaire data that the simulation \jas fun, interesting, and had 
a high motivational o.vveal. itost of the participants, learned a lot from the 
simulation including how to vorY. with other people* REVISORY S IIIFOPJIATIOII 
SU;'-2^!ARY : The RIS vas designed to not only assist rcvisors to assimilate 
infonaation collected during the pilot-test, but also as a unique -fay of • 
summarizing the data. The summary is a record of the strengths, vealcnesses 
and reconimendations for revisors from all data sources (i.e*, student tests, 
student questionnaires, teacher questionnaires, etc.) Trends have been 
extrapolated vhich list the most ^apparent strengths, weaknesses of the sijmila- 
tion as well as recommendations to be considered in the revievr of the simula- 
tion. 
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Manufacturing Production 

I. Brief Description of the Module 

This sinulation. Manufacturing Production, provides an opportunity 
for the student to esqplore and get a feel tor whether he/she might 
like to look further into nanuf actxiring occxxpations for potential 
occupational choices* The simulation consists of an Introduction, 
Preparation (let session), Paartlcipation (five production sessions), 
and a Suimary* Twenty-Height students nay opt into the simulation to 
work in the production of extension speakers (boom hoxes) that nay he 
attached to radios* An assembly line requiring thirty^eis^t steps is 
set Tip and put into operation* Of the twenty-eight workers, one is 
plant superintendent, four are si^ervisors, and those remaining ax^ 
product line workers* 

The Preview* or Introduction Section takes the form of an 
Illustrated comic book* Two caricatures, Peter and Polly, give an 
overview describing "The World of Work, Manufacturing Production"* 
They describe specifics of the simulation Including the tools, equip- 
ment, materials, and kinds of activities that a student might engage 
in to build extension speakers if he/she were to opt into the simulation* 
The student is then asked if he/she would like to participate in the 
manufacturing simulation* A slide tai>e presentation similar to the 
booklet is available and may be viewed instead of or in conjunction 
with the coodc book* The preview Is ^jcheduled to last about a class 
period* 

•*Prior to the preview, ihe students have seen a slide tape and/ ^r read a 
booklet on Introduction to Simulation* 
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The Preparation Section (Session l) begins with a slide/tape 
•'Manufacturing Production" which outlines the roles in the simulation 
and describes an organization chart. It continues with an explana- 
tion of the safety rules (which are also provided in comic book form) 
and directs the students to a handbook of instructions for the ;)ob ttppli-^ 
cations ('•What Job Would I Like?") The handbook guides a student through 
the preparation of several forms that help him/her choose and get into 
a role for the simulation* The student may choose to work in one of 
the five production a^eas; Fabrication, Assembly, Inspection, Super- 
vision, or Maintenance. Using an interest scoring sheet the student 
first works through an interest form from the records file. He/She 
records his/her scores and continues according to the handbook to work 
through the preference form, description sheet. Job application form 
and as a last activity obtains a company identification card. 

At the end of the Preparation, the job application forms are left 
with the instructor. Job applications are the final instrument for 
production area role choices. The instructor checks the job applica- 
tion form for conflicts in role choices. The preparation section is 
scheduled for about one period. 

At the beginning of the Participation Phase (Session 2), a slide/ 
tape "Operation Sheet - The Key To Your Job" instructs the group in the 
use of 1) operation sheets which direct them through their jobs and 
2) training aids (fila-K>-80und cartridges and talking pages) for specific 
tasks V Next the group hears a tape "Electing a Plant Superintendent" 
while simultaneously viewing posters on the same subject. Following 
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the tape and posters, one of the five students applying for the plant 
superintendent position is voted iiito office by the company employees 
using a plant superintendent ballot. The remaining four candidates 
receive supervisory positions by drawing from a hat of supervisory 
selection cards. The supervisory roles are in booklets titled: 
Production Supervisor, Production Coordinator, Quality Control Super- 
visor, and Maintenance Supervisor. Finally, a company meeting is 
held during which purchase contracts are signed, the number of speakers 
to be produced is decided upon, and the company is given a neae. 

In Session 3 (•tJd possibly k) another organizational coopany 
me«*ting is called to order by the plant superintendents The company 
employees view a slide tape program on the flow chart, hear a tap^ on 
the company handbook and files, and review the company naes of conduct. 
The supervisors continue their job preparation and training while the 
remaining employees are instructed to go to the Instructional Materials 
Center. Between Sessions 3 and h the production supervisor and production 
coordinator should have 'finished the production time chart in order 
that production fnay begin. If they have not, they continue to work on 
the chart while the remaining workers again go to the Instructional 
Materials Center. 

Assuming the production time chart is complete, the workers are 
called from the Instructiocal Materials Center and hired by the 
supervisors from a "worker pool" according to their ID number from 
the preference chari. The supervisor of each area then records the 
workers* names on a worker assignment sheet. Workers are also recycled 
through the worker pool when their jobs are completed or an opening 
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comes \xp that is their first choice on the preference chart. As 
production workers are hired to do an operation, thefr first 
responsibility is to take their training program from filia^o-sound 
35 cartridges found in the audiovisual files. In addition to his/ 
her work assignment, each employee is responsible for filling out a 
daily report form. 

By Session 5 , production is in fr-M swing. Each supervisor should 
be assuming his/her roles and checking to see that their workers are 
doing the same* A brief description of each of the st^ervisor roles 
follows. 

Production coordinator and production STxpervisor are closely 
related roles; in fact, they work from different copies of the same 
handbook during the simulation. The main difference in their respon- 
sibilities is that the production siqpervisor is in charge of fabrication, 
the production or manufacture of con^jonents or parts used in the 
speaker, while the production coordinator is in charge of assembly, 
putting together components or parts to form the speaker* They each 
have the responsibility of establishing a production schedule, Uring 
production workers for fabrication/assembly, supervising production 
workers in fabrication/assembly, controlling production, and assisting 
the plant superintendent. 

The quality control supervisor's job has four parts: inspecting, 
inspector hiring and sxxpervising, safety enforcement, and assisting 
the plant superintendent. The first part inspection involves completing 
the proper section of the "first part" checklist that applies to 
each day's production as well as looking for shoddy or otherwise 
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unacceptable workmanship* Inspector hiring and supervising involves 
hiring inspectors from the production worker pool when they are 
needed and retu ning them to the pool for reassignment when they are 
done* Safety enforcement involves general shop safety and opwationa 
safety* It is the quality control supervisor's responsibility to 
become familiar with all the company safety rules and see that all 
employees are familiar with rules too. During the simulation he is 
to watch, correct, and report any problems of safety to the plant 
superintendent. As a plant superintendent assistant, he will be 
required, as will other supervisors, to assist the plant superintendent 
upon request. 

The maintenance supervisor also has four parts to his Job: inven- 
torying tool/equipment /special apparatus; maintaining tools and equip« 
ment; supervising equipment and work area cleanup; and assisting the 
plant superintendent. Tool/equipment/special apparatus inventory 
requires the maintenance supervisor to complete an inventory sheet and 
to know the number of tools and equipment on hand as well as where they 
are. In addition, the maintenance supervisor needs to know the number 
of work stations (areas where a single operation can be performed) and 
act as an information source since the individual in this role will 
know more about the tools and equipment and the special apparatus than 
anyone else in the company. Tool and equipment maintenance requires a 
daily check of the tools and equipment to see that they are in good 
working order . The tools and equipment needed for all operations (l 
through 38) are illustrated, and instructions are given for replacement 
and repair of the tools. Equipment and work area cleanup are important roles 
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requiring tact and diplomacy on a daily level from the maintenance 
supervisor. He must oversee the cleanup of machinery and the work 
area, watch the time, and check for safety during cleanup. As a plant 
superintendent assistcmt, he/she needs to be ready to assist the plant 
superintendent upon request. 

The plajit superintendent works with other supervisors and 
staff to keep the manufacturing company organized and the production . 
line moving smoothly. :ie/She is responsible for resolving the 
personnel problems, time conflicts, and other problems that may arise 
in the simulation. Of course, the superintendent may at any given 
time choose to confer with top management (the instructor) to resolve 
difficult problems. 

Session 6 is a continuation of the production line with all parti- 
cipants continuing in their roles until the desired production qmntity 
is reached. (The production quantity should e. ^ual or exceed the 
total number of speakers can?)any employees contracted for when they 
signed their purchase contracts during Session 2.) 

The Summary provides the students with an opportunity to think 
about what they have done, where they are now, and where they would 
like to go in the future in terms of occupational exploration. The 
summary is divided into three tasks. The first task focuses upon the 
individual's experience asking such things as: "Did I like the working 
conditions associated with manufacturing production?" The second task 
focuses on sharing experiences and personal feelings about what each 
participant did during the simulation. The superintendent first 
calls a brief meeting, then the class divides into smlL groups 
to work on a presentation describing their roles during the 
simulation. The groups then come t'- *ether to hear each other's 
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presentations. Task 3 of the Summary uses a "decision point" form 
from the company files to give the participants an opportunity to 
think about how manufacturing production and other experiences in 
the simulation have affected their plans for exploring the world of 
work. The students receive their specUiera at the end of the simula- 
tion. 

Ideally the Manufacturing Simulation would take about 12-13 
periods of class time. Given, however, needs such as start-up time, 
getting-organized time, and clean-up time, the simulation more 
realistically is scheduled for about 15-18 periods of class time. 
The breakdown by class sessions is shown on the following page. 
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TABLE I - Estlaated Tiae Reqiilred for 
Slaulatloa Cocfflinents 



Simulation 


X!*81#XIBaT^eu IXIne 




in Clasa Periods^ 


Intrcauction to Slimilation 


X * d 


Preview 


1 


Frepetration 


1 


Participation 


6 


Sxuaaary 


3 


Total 


12-13 



(15-18 with allowance for preparation 
and clean-up) 



«A class period is assinned to contain a ndnimum of k3 minutes. 
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II. Description of Evaluation Procedures Employed 
Ji. Specific Saaple Used 
1. Schools 

Tot this module one Jefferson County and one Denver school were 
used. In each school there were two experimental and two control 
groxxpa. The schools and the teachers were selected via discussion 
with administrators and teachers In each of the districts. A brief 
description* of the schools follows. 

Wheat Ridge Junior High School (Grades 7-9) » Jefferson County > 

Wheat Ridge Junior High School is a small school with approximately 
725 students in grades 7-9- Twenty students are classified as mentally 
retarded. Generally, the school draws. its student body from a middle 
class, blue collar area. About 30 students come from families 
receiving Aid to Dependent Children (ADC) and many students are from 
divorced homes. The area of Jeff Co. represented by this school has 
many older single family houses. There is a sizeable retired subgroiip 
within the area population. The students are primarily white ( 93^) 
with the rest ( T^t) having Spanish surnames. The school reports t.iat 
standardized test results indicate that school scores are improvikig 
and that it is either at or above district norms in most cases. 

Lake Junior High School (Grades 7-9), Denver . 

Lake is a large Denver junior high school with well over a 
thousand students. Although demographic data was not available at 
the time of this writing several factors about the school are known. 
First, it has a sizeable percentage of students with Spanish surnames. 



^Descriptions were obtained by John Radloff of the Jefferson County 
project staff. 
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Secondly, in general Lake has a high rate of absenteeism. (As soo\i 
as additional data becones available, it will be appended to this 
report • ) 

2. Sample Within Schools 
a. Teachers 

In Wheat Ridge Jirnior High School two male industrial arts teachers 
Conducted the simulations* In Lake Junior High School one male 
industrial arts teacl^er conducted two separate simulation groiips. (Due 
to difficulty in obtaining questionnaire data from these teachers, 
further demographic data is not available.) 
b* Students 

State regulations in Colorado necessitated that a sijotulation of 
this type, i*e*, one involving a great deal of maniptaation of tools, be 
housed in an industrial arts setting. In Denver and in Jefferson County, 
classes utilizing the industrial arts facilities consist of all male 
students. Therefore only eighth and ninth grade male students enrolled 
in industrial arts classes were in the experimental grotqfis. These 
students were volunteered by their classroom teachers* To provide for 
coB5)arable control groiqps, intact industrial arts classes were selected 
for the control groups. The classes were generally a mixtwe of 
aigbth and ninth grade students* 

In siiiwiary, the saa?)ling was far fr<m ideal. While the procedures 
far 8aK)4>31ng ^thin the two schools were quite similar, the schools 
themselves were somewhat different. Caution should be exercised when 
ffiiUtlng interpretive d^ements about the experimental results of tht' 
pilot test* 



17 



11 

It atlso shcmld be noied that experimental results are bused only 
on students took both the pre and posttest* There ims sample 
loss in the testing of the module as follows ! 

- Denver experimental grotips , of tlie thirty-five students who 
started the module » thirty students coopleted it (fourteen 
percent loss); 

- Jeff CO experimental groups , of the twenty-nine students who 
started the rodule, twenty students completed it (thirty-one 
percent loss); 

- Denver control grotqps , of the thirty-six students who took 
the pretest, twelve did not cooplete the posttest (thirty 
three percent loss); 

- Jeff CO control groups , of the twenty-six students who took the 
pretest, thirteen did not complete the posttest (fifty percent 
loss). 

Across the four types of situations described above the percentage 
loss is approximately thirty-one percent. Saople loss is always 
difficult to account for in an esqperimental situation. Some students 
msy have been sick or otherwise out of the classroom during the pre 
or posttesting time. The logistical set-up for the test of this modiae 
required that an administrator be present at each testing session. 
Provisions for follow-up testing of students who missed a session were 
not feasible given the available manpower in the field* Some students 
may 8i^>ly have avoided taking the tests. Stxidents in industrial arts 
classes miy hav« an especially strong disposition against tests. The 
ssj^le loss, at any rate, is larger than one would ordinarily like to 
see. Caution, therefore, should be taken when interpreting the 
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experlMntal resxiltt of the pilot test. 

B. Types of Clastes and Groupings 

Given the unique nature of the asnufaeturing sisulation, only 
existing intact classroom iiere utilized. Since the simulation was 
designed for a mcxioum of 28 students per grotrp, all class swiibers within 
an intact clasiiroom participated in the nodule. The module was tested 
within the industrial arts area of the two schools. These areas were 
f-rte from competing influences or distractions and it was felt that 
students were able to experience the module in the manner intended by 
developers. 

C. Experimental Design as InpleaBnted 

Since the industrial arts classes involved in this pilot test had 
only male stiadents, partitioning of the groiips Ijy sex was not possible. 
Aside from this one difference » the design is basically that stated in 
the proposal. Schematically the design could be depicted as shown 
on the following page. 
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Figure 1 - Schematic of the Experimental Design 
For The Manufacturing Mciule 



Lake 

(Denver) 



Wheat Ridge 
(Jefferson 

County) 





Freteat 


Posttest 


1 — 




Si 

1 


Es^erinental Grovqp #1 


t 
1 
t 

Sn 


t 
1 

Sn 


Bxperiiaental Groizp #2 








Si 
1 


Si 
1 


Control Groi^) #1 


1 

Sn 


1 
1 

Sn 


Control Qrorxp #2 






Experimental Group #1 






Experiiantal Grotq? #2 






Control Grotqp #1 






control Grotp #2 







*In order for a student's scores to be included in the analysis, 
he wovild have had to participate in both the pre- and posttest. 
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The anaOyiis will be the same as designated in the project proposal 
fOT the Occ\q)ational Exploration Program (FY'TU) vith the exception that 
the sex variable has been deleted. Of key interest will be the inter- 
action between the experimental-control variable and the pre and postcast 
variable. If the nodule has had an impact upon students, a significant 
interaction woiad be expected with the source of the interaction being a 
sizeable experimental grcnxp gain on the posttest. Separate analyses will 
be run for the total cognitive test scores as well as for two dimensions of 
the attltudinal scale. The analyses will be in accordance with the 
abbreviated sumazy table shown below. 
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Table 2 - partial Anova Sunnary Table 
For The Manxif acturlng Mesdule 



Source* 



df 



Potential F Test 



Between Students 



abcn-1 



Term No. 

1 
2 

3 
k 



Between Classes 

A 
B 

AB 
C/AB 



abe-1 

a-1 
b-1 
(a.l)(b-l) 
ab (c-1) 



lA 
2/k 
3A 
V5** 



Within Classes 
5 e/c/ab 



abc (n-l) 
abc (n-l) 



Within Students 



abcn (d-1) 



6 
7 
8 

9 
10 

11 



D 
AD 
BD 
AED 

cd/ab 
ed/c/ab 



(d-1) 
(a-l)(d-l) 
(b-l)(d-l) 
(a-l)(b-l)(d-l) 
ab (c-1) (d-1) 

abc (d-1) (n-l) 



6/10 
7/10 
8/10 
9/10 
10/n** 



Total 



abcdn-1 



♦A brief discussion of the variables vlll be included in the text ianediately 
following this table. 

«»If the results from the two starred P tests yield insignificant F ratios, then 
the two terms k and 5, and 10 and 11, could be respectively pooled and tised 
for the reminder of the appropriate P tests. 



22 



16 



The ittdevendent variables for this module are described beloir: 



Variable 



Descriptioii 



Treataent (e3qperiBient5l vs« control) 



Fixed; between levels 

of C 



B 



Schools (Denver vs. Jefferson County) 



Fixed; between levels 
of C 



Classroonui (n=8) 



Randott; nested within 
AB 



E 



Testing (Pre. vs. Post) 



Students 



Fixed; within S*s 
(repeated measure) 

Randon; nested within 
ABC 
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Inatrunentatlon > Instrw at Specific 

1. Knowledge Test - What Do You Know? (The test is appended to this 

report) 

The knoirledge test for nanufacturing consisted of 3$ questions. 
The test included l6 aultiple choice qxies^ions and 19 Matching type 
questions. In general, the questions vere at a loir cosprehension level 
in relation to the Bloom Taxonoiv* Three basic areas on thrusts vere 
eaphasized in the tests: process (10 questions); responsibiUty (10 
questions); and environment /tools (1^ questions). 

An exantple of a process question is as foUoirs: 
Test Question #5 

Which of the folloiring things is xnanufactured? 

a. Coal 

b. Haircut 
♦c. Candy bar 

d. None of the above 

♦Indicates correct answer 

Process qwstions generally deal with understanding the steps involved 
in aianufacturing a product, understanding what information might be 
necessary to perfom a certain function, etc. 

Responsibility questions are focussed on who or what group has 
responsibility for making decisions at a certain point in tine, etc. 
An example of a responsibility question is given below. 
Test Question #3 

Which of the following assignments would be a major responsibility 
of the plant maintenance s\q)ervisor? 

a. Scheduling production time 

♦b. Supplying tools 

c. Analyzing defects in products 

d. Planning new products 

♦Indicates correct answer 
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Environaent /tools it a category of quest ions which deal with 

uader standing the environaent one works in, the types of tools that 

night be used In a j6b» the functions of tools , etc. An exasple of a 

question froiQ this category is: 

Test Qxiestion #U 

In manufacturing production many different kinds of tools are 
Tised to perform various functions. Itotch the function with the tool 
needed to perf om the function by placing the letter of the function 
by the tool. Place only one letter by each tool. 





Function 




Tool 


a. 


shaping 


#b 


staple gun 


b. 


fastening; 




glue gun 


c. 


cutting 




utility knife 


d. 


grinding 




serewdriTer 








scissors 








box and pan brake 






_b 


rivet gun 








ttiter box saw 








tin snips 








Sander 








soldering gun 






JO 


handsaw 








squaring shear 



^(The letters in this coluam indicate the correct answers. 
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2. Affective Test - What Do You Like ? (Tlie test is appended to this report.) 

The affective test iras designed to waaure attitudinal change on 

the part of the sttuient* The first five questions consist of asking the 

stuient if he/she would like to try doing an activity. The student could 

rettpoAd in one of four wayu to the itea. 

-Yes, I vould like to try this 
-No, I would not like to try this 
«I*m uncertain about trying this 

-I don't have enough infomaiion to know if I would like to try 
this. 

The scale is scored so that the stronger the preference for trying 
to do an activity, the higher the score. Thus, yes and no responses 
receive the sane scale valtie of 3, uncertain responses receive a 2 and not 
enough infonaatlon types of responses receive a value of 1. These values 
are then suaned and used in the analysis of variance described earlier. 
Sunned scores can vary from zero (no response whatsoever) to 15. Note 
that the scale is scored so that strength of preference, rather than 
direction of preference is the important factor (i.e., ye J and no responses 
while being ^ in opposite directions, represent the sane strength ot pre- 
ference and therefore receive the sane score). 

In addition to the scaled responses, students were encouraged to 
state reasons for their preferences. These reasons were classified and, in 
conjunction with the scaled responses, were coded and transferred to 
nacbine scorable foms. Checks were aade on the scoring procedures to 
assure that the data was reasonably accurate, expecially with regard to 
the first five questions. 

There were 13 other questions incl\ided in the What Do You Like? 
scale. The 5 questions follcwii:« those imt described were sinilar in 
nature to the earlier ones, but tney required the student to siqpply or 



20 



fill In the type of activity that he preferred or did not prefer to do. 
Given the totally open-ended nature of this set of questions, it vaa 
difficult to develop an adequate and relatively exhaustive scoring scheme. 
In addition, given the state of development and the early trial nature of 
the pilot test, a decision vas made to exclude results from these questions 
in the analysis of variance* 

(The last 8 questions on the test were open-ended and asked the 
students about the eacperiences one should have before deciding on a job, 
the types of things that one should consider before taking a job, etc. 
The responses were classified and scored. Due to some difficulties in 
scoring these questions, results will not presented.) 

3. Student Post Module Questionnaire > What Do You Think? (The question- 
naire Is appended to this report.) 

This questionnaire was administered to sttidents after they had 
conpleted the nodule and the module posttest. This instrument was admini- 
stered only to the students who participated in the module. The content 
of the questionnaire relates directly to student preceptions of the module. 
The first twenty questions are in a scaled format. Questions in this set 
relate to a student *8 perception of the clarity of directions, the extent 
to which the module interested him/her, etc. For analysis and uiie, the 
results will be gro\:?)ed and descriptively reported by the subject area to 
which they pertain. Other questions in the questionnaire deal with parts 
of the mod\ile the stxident liked best, parts he/she liked least, role(s) 
played in the simulation, etc. These questions will be descriptively 
sumnarized and Included on the Reviser *s Information SuMuary (RIS). 
Teacher Evaluation Log (The log is appended to this report.) 
The Teacher Evaluation Log consists of six Instruments packaged in 
one booklet. The Instrument order within the log parallels the ordering 
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Of the laodule* In other words, after studenta had completed the Intro- 
duction to Siimxlation, teachers muld fill in the questionnaire regarding 
that part of the modiae* After students had conqpleted the preview, teachers 
would fill in the questionnaire pertaining to the preview, and so on. 
Below is an instrument by instrument description of the six instruments 
contained in the log* 

LISTIRG AND DESCRIPTIONS OF TEACHER EVALUATION LOG 



No. Questionnaire 

I. Introduction to 
Simulation 



General Description 

What materials were used; effectiveness in 
terms of student understanding and interest, 
technical quality, suggestions, etc. 



II. Module Preview 



What materials were used, effectiveness in 
terms of stiident motivation, technical 
quality, etc. 



III. Preparation Phase 



Similar to above questionnaires with the 
addition of questions regarding integration 
or fit with the rest of the module and 
qtiestions pertaining to the role selection 
process . 



IV. Participation Phase 



A questionnaire similar to a daily log 
wiierein teachers primarily identified 
student and teacher problems in getting 
tasks done. 



V. Sunnary Phase 



Questions relating to the summary in terms of 
its being a reasonable culminating activity, 
etc. 



VI. General Module 
Evaluation 



Questions relating to the overall adequacy 
of materials, the sequencing of materials, 
module implementation, student participation 
and learning, etc. 



28 



5, Teacher Post Module Panel Revlev 

After a nodule iras coopleted, the teachers vho had participated 
in the pilot test nere convened to discuss the module* Per each 
individual section of a nodule teachers vere asked about: the i>arti- 
cxilar strengths of that section; the weaknesses; classroom solutions 
they used to overcone ircaknesses; and vhat recoonendations or suggest- 
ed changes they had for revising the nodule. Emphasis during the review 
was placed \xpon prdbirig into their perceptions of the nodule and looking 
for consensus anang the teachers* 
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III. RESULTS 



C. 6 Studiegt (jaestlonnaire t Collated Open^Ended Responses 
to Questions #23> #2^» #30> tod #31 > 

#23. list a few reasons nby you liked or did not like 
yoor role (or roles )# 



I liked them, fun^ O^K., interesting (17) • 
They \«ere easy (l). 

There vas too much tiw iraiting between operations ^ 

took too long (2). 

It was scnething I knew already (l). 

It was boring (U). 

The roles were fine but the pecsple I worked with were 
always playing and trying to do other peoples Jobs (1). 

(No response-ll) 



i - 48 



#2$. Describe the one thing ifhich you feel you did best in the 
sinxlation and the one thing you d5.d least ifell< 
Be sxure to say nhy you did mil or poorly. 



Best Thing 



Gluing {k) 



Sanding (2) 
Box Baking (3) 
Metal layout (2) 

Single responses: 
Rivet 

Standing around 
Hand driller 
Everything 
Screwing on legs 
Inspect 
Free speaker 

Put together irires & Jacks 

Printer ^ 

Sitpervise 

Printing 

Bending 

Not sure (2) 



Reasons 

I put a lot of glue on; 
B^fCause 1 iranted to; It vas 
easy. 

Because I liked it. 

It was fun; I did it well. 

It ifmnt along flaat* 



Don*t knov 
Nothing to do. 
Went fast. 
Easy 

I likMl it. 

It's free 

Only fun thing. 
Far out« 
It vas fun. 
None 



(No response = 23) 
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^3 



/fe5. (continued) 

Wor st Thing 

Hone (10) 
Cut artal (2) 

Single Kesponses: 

Slectronics 

Putting on contect 

JrlllJng 

:ax 

Test 

8taeet Metal Layout M*n 



Reasons 



Needed help* I didn't cut stnlglit 
all the tine* 



Nothing worked^ 

I didn't knoir haw to mil* 

Eoring 

No 

Boring 
Boring 

I just laid aroonl 



(No response » 23) 
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#30» Najae sane of the tbings you liked neat about the simlation 
and scxae of the things yoa liked laaat about the simulation. 



Liked ttost 

Speaker (10) 
Gluing^ glue gun (3) 
Working with others, wrking 
with ftriends (2) 
Inspecting (2) 

Single responses: 

Tlie sanding 

Working 

Everything 

It was fun 

Patting it together 

B6ring 

Box Baking 

Box naking 

Bending the metal 

BoDC printing 

Put the paper on the netal 



Liked Least 

The wrk (3) 
Paper wrk (2) 

Nothing (7) 

Single responses: 

The Mhole thing? there 

was nothing to dol 

The paper on it 

Didn't get paid, no benefits} 

no lunch break 

The nay they ran the whole 

program 
Inspecting 
Everything 
The Aolder 



(No response -2k) 
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U5 



i^31. Write doim sone of your ideas on how the sinUation might be 
made better* 



Change Jobs everyday. 
Soldei* guns 

If they didn't aake cartons • 
I think it iras good enough. 
Better Jigs 

You can^t make it better. 

By putting better paper like cougar or lion designs. 
Made a good cart - OK. 
It wa« OK {d). 



(No responses = 3^) 
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III. RESULTS* 



E. 2. Teacher Post Module Panel Review 
Reporting Pom 



A 




Title of Module ; Manuf€u:turing Production 

LEA: Jefferson County, Colorado and Denver, Colorado 

Panel Leader : John Radloff 

Panelists ; James Sheeder - Denver 

Robert Caa?)ibell, McKinley Turner - Jeff Co 
Observer Participants : Maureen Anderson, Mary Harris - Jeff Co 

Janes Fales Texas A & M 
Date(s) Panel Met : January 23 and 2U, 1971^ 
Kunber of Hours : (9 Hours Total) 3+ vith paneUsts 

' 6 Anderson • Fales - Harris 

♦Interpretation has not been provided. 
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IV. Reviser's Information Summary (RIG) 
A. Description of 'he Summary 
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The Reviser's Information Summary v;as developed for the purpose of 
assisting revisers to assimilate information collected during the pilox 
test of a module. To accomplish this, Information from each source 
available was first reviewed and then only major thrusts or ideas frora 
the source were summarized, (These key thrusts or ideas rare determined 
by the judgment of the authors of this evaluation report.) The summary 
was then transferred to the appropriate location on the lar^je sheets 
which constitute the RTS. Lastly, each column was studied and trends 
were drawn and so recorded at the bottom of the sheet. Tn nscertalninp, 
the trends the authors used their familiarity with data, the module, and 
the data collected. 

In general there will be one Reviser's Information nummary sheet per 
part of the «T>odule and one-two sheets covering, the overciii nature of tho 
module. On sheets which pertain to module parts, on]y some of the datn 
sources provided information pertinent to that part. !ienct», the sheets 
do have some blanks or missing data celJs. The reviser should exercise 
extreme care in interpr*.'ting the information on the snoets and should 
always keep in mind th?it comments on the sheets represent only a summary 
of key points. In addition, H sometimes was most difficult to victcrmine 
a trend In the information obtained. 

B. Use of the RI3 
One way the reviser miF,ht use the RI3 is as follows: 

1. Read the module become thoroughly familiar with it; 
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2. Read the first paxt of this report (Section I and II) thoroughly. 
Skim the results compiled in tables (Section III, parts A, B, C, D, 
and E.) Read Section E-2, tne teacher panel review report 
closely; 

3. Read and study the Reviser's Information Summary. (Consult 
original data sources, if necessary.); an<i 

U, Generate a set of revision specifications hased upon knowledge of 
the module, the Reviser's Summary, project developmental criteria 
and other information, if appropriate. 



er|c 



REVISER'S IMFCBMATION 
SUMMRY 



STRENSTHS 



The students responded favorably that the 
module helped them to learn about dobs and 
how to work with other people {k6%) and 
answered Job questions (^3^)* Forty-three 
percent of the students would like to do 
another module. (However in each case these 
percentages leave a majority of the students 
reacting with uncertainty or negatively •) 

When asked to list reasons why they liked 
their role(s), seventeen of the forty-six 
students responded that the roles were liked, 
were fun, O.K., or interest ing. 

See individual listing for positive open- 
ended responses. 



Manufeuiturlng: Overall Cons: 



WEAKNESSES 



Student responses to questions dealing 
module and specific module parts were 
In no case did a majority of the studei 
The greatest number of negative responi 
too many tests and forms to fill out. 

See individual listing for negative op 



1. There was almost unanimous response that 
the simulation was fun, interesting, and 
contadned some enjoyable activities re- 
sulting in high motivational V€LLue. 

2. Most of the participants learned a lot 
from the simulation including how to 
work with other people. 

3. Most would like to go through another 
simulation and would recommend it to 
friends. 



1. Technical errors in slide/tape prQ 
and students and added negative in 

2. A few students would have preferre 

3. There is considerable confusion a! 
is expected. 

U. The unit is too difficult for some 
concepts are not understood. Teac 
consistent with the maturation lev 

5. Both teachers and students coraplai 
too much to read. Students tended 
and not the manuals. 

6. The forms are too long and numerou 
were not even used. 

I 7. There is extensive overlap of mate 
other evaluation instruments, and 

8. The directions need increased clar 

9. The simulation is perhaps trying t 

10. Many of the students felt that the 
dumb and immature. Some students 
were beneath the grade level and n 
school student, that they made stu 
seriously and treat it as a game, 
forward approach would be preferah 

11. Several felt that the pretest and 
and detracted enthusiasm from the 



♦it is unclear as to whether teachers or students gave the above responses. } 
from the teacher evaluations, student questionnaires, student interviews, an^ 
Since the data was comingled in this manner, it is difficult to determine fr\ 
when reviewing the panel results inasmuch as they contain data from several i 
collected for this module. 
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BKCOrO'SriDATIOjJS FOR REVISION 



rith perceptions about the 
ry divided in nature. 
;s agree on a response. 
IS indicates that there were 



i-ended responses. 



ams frustrated teachers 
ict to simulation, 
doing something else. 
>ut what to do next and what 

itudents to read and many 
TS find that it is not 

of the students, 
id vehemently that there is 
;o read the operation sheets 

therefore, many forms 

al in the pretest, posttest, 
unmary. 

y. 

cover too much material* 
tolly-Peter characters were 
It that the characters 
urity of th' junior high 
nts take the project less 
id that a more straight- 
. 

sttest were too difficult 
ftal product. 



1. Eliminate technical errors in slide/tape programs: heginning 
of tapes difficult to understand, speaking too fast for 
comprehension, slides and filmstrips often failed to advance 
properly. Include provision for equipment failures. 

2. Arrange the handbooks chronologically* 

3. Consider having introductions he of a different color rather 
than a separate page. 

Arrange the handbooks in chronological order and provide an 
index (or outline or table of contents) as well as a glossary 
at the beginning* 

Use simpler sentence structure and highlight main points with 
italics or bold print for easy review and for reference* 
Reduce the amount of printed material distributed- For 
example, directions could be printed on all forms rather 
than in a separate booklet. 

Reduce the amount of reading required and shorten the forms* 
Consider whether charts should be retained as they are, 
confusing, and the directions for their use need clarifying* 
9. Consider the question of whether manufacturing constitutes a 
cluster and this simulation a portion of it, production and 
production supervision. Other cluster segments might be sales 
and distribution, research and development, production 
planning, and administration* 

10. Evaluate use of Polly-Peter characters. 

11. Re: pretest and posttest, downgrade vocabulary, and reduce 
number and length of forms. 



5. 
6. 



7. 
8. 



• this module all information obtained from teachers was synthesized in Jeffco 
nterviews with the project developer and editor. (Also see Table D. 1.) 
which source specific comments are drawn* Care should therefore be exercised 
trees. Also, it should be noted by the reviser that no Teacher Logs were 
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Mnnii'Pnr'fciirinfir • Overall Coi 


DAIA 

SOURCE 


STKhNGTHo 


WEAKNESSI 


STUDEOT TESTS 


The strength that emerged from the pre- 
and poattestinfit is that there is some 
shifting of student attitudes as measured by 
strength of preferences. Students, who 
experienced the module, did have stronger 
posttest preferences than those who did not, 
although these results did not reach a point 
of statistical significance. (Also see 
comments in weaknesses column.) 


V/ith regard to cognitive achieveme 
of students showed virtualy no cht 
to either lack of module impact oi 
somewhat high pretest scores were 
rence would tend to make it diffic 
already high set of scores. With 
actually stated fewer reasons to , 
posttest than they did on the pre' 
reasons did not change to any grei 
response pattern of students in tl 


TEACHER LOGS 


Logs were not collected for this module. 




CO 


1. With regard to data collected from student 
questionnaires, ^0;^ or more of the students 
responded that *he module helped them to 
learn about jobs. While that is not a 
majority, it does not indicate that the 
module does have the potential for providing 
occupational information to students. 

2. This is corroborated by data trom the panel 
which indicates that the module does have 
some interesting and enjoyable activities. 
Also, student attitudes, as judged by 
strength of preference, did change. 

3. Note: The above two points may be more 
indicative of the potential of the module 
rather than existing strengths. This 
observation is prompted by the large number 
of problems that occurred in the imple- 
mentation of this module as well as by the 
fact that mai^y of the participants did not 
positively respond to the module. 


1. With regard to many of the que 
"iVhat Do You Think?" quest ionni 
quite divided. The module was 
50^ positive response to any q 

2. Students did not increase the! 
simulated. (This may be a par 
level of pretest scores achiev 

3. V/hile strength of preferences 
reasons supporting preferences 
phenomenon could be a result o 
associated with the module. 

U. There are extensive problems r 
the module. A sampling of the 
below. 

- Excessive forms 

- Confusion with regard 

- Excessive amounts of 

- In some instances, co 

- Scope of simulation m 

- Technical errors in s 

- Also see other weakne 


i 
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Kiderations (2) 



it the experimental group 
ige • This may be attributed 
perhaps to the fact that 
sichieved. This latter occur- 
ilt to shov; an increase in an 
regard to attitude, students 
istify their preferences on the 
sst. Moreover the types of 
degree when compared to the 
control group. 



63 



RECOMMENDATIONS FOR REVISION 



:ions contained in the 
Lre, students responses were 
aot able to command even a 
est ion. 

knowle^lge of the area 
Lai function of the high 

I.) 

Ld change, the number of 
iropped considerably. This" 
having too many forms 

lated to the implementation of 
et of "oroblems is listed 



;o directions 
►ading 

lept difficulty 

^ be too large 

Ide/tape programs 

;es noted throughout the RIS. 



Both in the column above and throughout the specific RIS 
sheets mginy recommendations for revision are given. In 
this space no attempt will be made to pull together all of 
the recommendations, however, several major threads will 
be described. 

- Reconsider the structure of the simulation with 
a view toward greatly streamlining it. 

- Improve the directions in the simulation and 
carefully review the vocabulary with regard to 
difficulty level. Simplify sentence structure. 

- Reduce amounting of reading, shorten and/or 
eliminate many of the forms. 

- Review the conceptualization of the material 
presented in the simulation. For example is the 
detailed planning phase appropriate for the 
maturational level of the students? 

- Also see other recommendations noted throughout 
the RIS. 
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DATA 

SOURCE 



STRENGTHS 



Manufacturing : Intro 
WT3AKJESSE 



CO 



CO 



CO 



P CO 



CO 



From an incremental test done in the Fall 
of 1973 *the following results were olDtained: 
Q7% (n=15) or more of students using T:he 
materials felt that they understood the 
materials and that the vocalDulary was 
easy to understand « 



When students were questioned wit 
enjoyment with the introduction, 
etCo the pictUT'i "became somev/hat 
-Only 33% of the students were 
of enjoying the "booklet or the 

-A"bout 1/3 of the students irere 
of liking the illustrations • 



^Test data was collected from students in Upper i\rlington, Ohio. 



O CO 



CO 

i 
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See atove column 



See alDOve columr 
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R7:co?.:!'iE:mATio>is for revision 



-Sli{3htly over one-half of the students recommended that the 
slides and booklet be used together, with the slides coming 
first • 



The teachers recommended doing the Introduction to Simulation 
and Previe^sT on different days. 



Gee above column 
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DATA 
SOURCE 



STRENGTHS 



Manufacturing: Pre-g 
WEAKNESSES 



CO in 



CO 



P CO 



CO G>* 



g 

O CO 

< ^ 



CO 

g 
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Most students used both the slide/tape 
and comic hook. 



surprisingly, in this instance, no parti- 
cular strengths were identified hy either 
teachers or students. 



There vas mixed response to the quest ic 
helped to prepare the students for the 
answering positively, 25% uncertain, ai 



1. Teacher panels indicate a low rati] 
effectiveness for stimulating inte: 

Evaluator's note: Perhaps this wa 
negative reaction to the Polly-Peti 

2. Both teachers and students felt thi 
long. 

3. Teachers did not give the education 
slide /tape a high rating • They fe! 
matter was covered in too short a 
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A mixed student response and low rati 
preview apparently stemmed from sever 

1. The comic hook didn't stimulat 
cue to the Polly-Peter charact 
far below the maturational lev 

2. The slide /tape was too long an 
subject matter. 



.ew 



1 of whether the preview 
simulation with 30^^ 
1 33^ negatively o 
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for the comic book's 
*st . 

partially due to the 
characters • 

; the slide/tape was too 



slL quality and worth of the 
t that too much subject 
Lme and too briefly. 



1. Evaluate how to make comic book stimulate student interest. 

2. Have the preview on a different day than introduction to 
simulation. 

3. Divide the slide/tape into two sections, one an introduction 
to manufacturing production, the other on simulation. 

h. Place more emphasis on teamwork in production and line-staff 
organization. 

5. Relate roles to areas on interest form. 

6. Use the booklet first, then slides. 



g of the teachers for the 
L factors: 

student interest, possibly 
TS which may have been too 
1 of the students involved. 

tried to cover too much 



Teachers* suggestions for revision as given above should be 
studied as a means of strengthening the preview. Of special 
importance is the need to present the Introduction to Simulation 
and the :Teview on different days. 



ERiC 
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DilXA 
SOURCE 



STRENGTHS 



Manufacturing : Preparat 

l-.'EAKMESSES 



03 



0} 



Role selection got the most positive 
response given "by the students to any 
questionnaire item with 30% answering that 
they liked the way they selected their 
role(s) in the simulation. 



References to too many forms to fi3 
least partially uirected at the pre 



1. Good information on the slide/tape 
"Manufacturing Production" . 



1. Poor retention of information on s; 

2. Students and teaxihers felt that th< 
long. 

3« Teachers agree that students dii nc 
Job Would I Like?" 
Present choice system allows persoi 
#1 choice and maintenance as #5 ch< 
supervisor; yet person who selects 
may never get to do any maintenance 

5. Confusion among students regarding 



Information delivery about roles from the 
slide/tape evidently resulted in a positive 
student reaction to the role selection, 
although there are some reservations as 
noted in the next column. 
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The teachers commented on some confusic 
role selection, possibly due to poor re 
information. This could have been caus 
of the slide/tape. This mention combir 
there v:ere too many forms to fill out fi 
make use of the booklet indicates that 
not used in a balanced v/ay to allow foi 
by ^ variety of materials. 
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out may have been at 
)aration section. 



.de/tape. 

slide/tape show was too 

; use the booklet "What 

to select supervisor as 
.ce and become a maintenance 
laintenance as #1 choice 
work. 

•ole selection. 



anong students regar-linr^ 
.ention of the slide '^tape 
id by the excessive length 
id with comments that 
id that the students did not 
erhaps the class time was 
li ''-g^ tion reinforcement 
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1. 



2. 



3. 

k. 
5. 



Divide the slide/tape into two parts: Manufacturing production 
(explanation and illustration of Jobs in each category, infor- 
mation on Job application and preference chart), and safety. 
The safety portion should be closer to actual production and migfa 
be shown twice to non-technical arts students. Additional 
emphasis is needed on caution necessary in using glue guns. 
Teachers dealt with safety instruction according to class 
background. 

Evaluate statements of Peter and Polly and revise any^that seem 
too "corny". 

Revise getting into roles. 
Improve directions for role selection. 



Teachers suggested sonie revision with improved directions for 
role selection. The slide /tape might be divided up with one 
part providing additional emphasis on safety. 
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DATA 
SOURCE 



i 



ERIC 



STRENGTHS 



1. The roles written into the manuals for 
Production Supervisor, Production 
Coordinator, Quality Control Supervisor, 
and Maintenance Supervisor provide 
important and valuable experiences for 
the student. 

2. Most thought that the operation sheets 
and operations per se were excellent. 
The filmosounds, talking pages and 
operation sheets were helpful in facili- 
tating student self-direction. 

3. The "terms to tackle" got good response 
from teachers. 

I4. The working drawings got good response 
from both students and teachers . 

5. The tape and posters on "Electing a Plant 
Superintendent" were a good change of 
pace in activity. 



Evaluator's Note: 

The filmosound cartridges used for this 
module will not fit on the new model of 
the machine. 



1. 
2. 



3. 



9. 

10. 



11 • 
12. 



13- 



:.!anuf act ur ing : Pa 
VnilAKNESSES 



The speaking on the tape "Elect 
too fast. 

Because of difficulties with co 
ing as noted in the comments fo 
(and possibly forms) were not i 
students 'Selt the operation she 
Teacher and student comments m 
•»risors to have mere time for st 
together, and developing sMlls 
other and with the workers. (F 
this process). This would irapr 
vision, and workers' responsibi 
visors lacked confidence becaus 
In absence of Production Superv 
take over his job. 
Students "goofed off" and inte^* 
Maintenance supervisor did not 
The slide /tape on the flow chal 
words of the speaking text run 
about where and when students a 
low student comprehension. 
The production schedule guidebc 
out extensive teacher help. Tl 
calculation sheet. 
The directions on the operation 
There were specific difficultii 

a) The solder was of poor qual: 
response also indicates a m 

b) The students did not like tl 
coverings and some were not 

c) Many students cannot use a t 
or tape player. 

d) Paint comes ol*f the sanding 
come off. 

The Company Rules list was not 
There was unanimous agreement > 
with printed work and would of 
and supervisor forms. This hai 
control. 

There are times (at start of pi 
have nothing to do. 
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1. Slew the speaking rate on the tape '^Electing a Plant 
Superintendent", 

2. Add a poster to the tape/poster series with a list of plant 
superintendent qualifications for the clr -i to read while thej 
hear it on tape. 

3. Condense manuals, revise reading level, and remove duplicative 
information • 

k. Expand the time sequence to allow the supervisors to have 

more time for planning and training. Perhaps the entire clasi 
could be involved in the supervisory training for greater 
understanding of the entire production process and other rolei 
Then after that time, discern which individuals icant super- 
visory positions and develop a procedure for selecting super- 
visors and plant superintendent. Or there could be productioi 
planning during the supervisory training. 

5. Improve workers' responsibility to the supervisors; 

6. Redesign sequence of supervisor's training to choice between 
a) fabrication and b) assembly and quality control and use 
these two descriptions throughout. 

7. Develop audiovisuals for use during the supervisory training. 

8. Revise the role selection procedure and improve the direction 

9. Reduce the importance of the maintenance supervisor's role, 
perhaps to inspector rank, with care of equipment as primary 
responsibility. 

10. The production schedule guidebook should be revised and sim- 
plified. If all students take supervisory training, it could 
be developed into a more comprehensive activity. Otherwise 
it might be possible to eliminate it altogether and tell 
students the sequence of operations. 

11. Reduce the amount of written material given out and improve 
the distribution so that information is given only immediu.el 
prior to use (such as company handbook and file contents). 
The oTjeration sheets should not be used until after the 
corapaiiy meeting in the first session (which might necessitate 
an additional session). 

12. Correct the difficulties with the resources: 

a) Select better quality solder and different soldering iron 

b) Have variety of coverings available for speaker; make 
certain coverings will adhere. 4 4. j 

c) Use a miniature jac or give students a choice of miniature 
or sub-miniature. 

d) Find solution to paint coming off of sanding Jig. 

e) Improve instructions on bending sheet metal. 

13. Improve production flow. / 
lU. Test functioning of sound ahead of time. 

15. One teacher recommended that there be an example of each 
operation already completed. 

16. Consider eliminating the company rules list. 

17. Perhaps some of the charts could be replaced by a flow chart 
which combines information and thereby reduces the number of 
printed sheets handed out. 

18. Put directions on forms rather than in separate booklet and 
combine and simplify forms. 

19. Add a reference point to score scoring sheet. 

20. On worker assignment sheets assign as many students a possib 
to first job that takes the longest time. 
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A niodcrate nuniber of students felt that the 
tasks were not too complicated or hard 
(22 or 1*8^), "^hile 20 {k3%) did not have 
trouble knowing what to do next. 




Teachers pointed out that the role activities 
were excellent, providing important and 
valuable experiences for students. The 
materials used and the variety provided got 
good response. However, while some students 
found that progressing through the module was 
no problem, the overall feeling was that 
there were a great number of specific imple- 
mentation difficulties as noted under weak- 
nesses* 



Few students reacted enthusiastic 
the simulation being exciting; of 
answered positively, 15 (33^) unc 
negatively* Corroborating this r 
module boring, while 15 {33%) dis 
15 (33'^) were uncertain* 
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The major weaknesses reported fal3 

1. An excessive amount of printed 
students and had negative inp« 
result, several pieces of mate 
employee and supervisor forms j 
even the manuals* It appears 
only operation sheets, the pre 
the slide/tape. 

2. There were difficulties in cor 
materials ani the slide/tape, 
difficult to use without extei 
speaking on the slide/tapes wi 

3. There were specific difficult: 
as noted by the teachers abov< 
The student attitude toward tl 
hoped for, with significant pel 
the module boring or at least 
ties in with the teachers* coi 
when some workers had nothing 
tended to "goof off" and intei 
that the maintenance supervis( 

5* The supervisors were unable t( 
complete success, perhaps beci 
study, plan, and develop skill 
workers * 

6* The production schedule gutriel 
may be above the maturational 
7* There apparently were far too 
8. Given the large number of r( 
there are many implementation 
phase* 
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Participation (2) 
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lly about the activities of 
the 1^6 students, 13(28^) . 
rtain, and l8 (39^) 
sponse, 1^ (30;^) found the 
gresd with them sr^ another 


• 










into the following areas: 
material overv/helmed the 
t on the simulation. As a 
ial went unused such as the 
the company rules list, and 
hat the students got by with 
action schedule guidebook, and 

rehension with both reading 
The reading materials v;ere too 
ive teacher help, and the 
too fast and run together, 
s with some of the resources 

module was not as would be 
entages of students finding 
ot exciting. This reaction 
ents that there were times 
0 do, that the students 
ere with the activities, and 

felt unneeded. 
carry out their roles with 
se they needed more time to 

for communicating with the 

>k «.,<5 presently constructed 
5vel of the students, 
any printed forms to complete, 
w ^ tions it is clear that 
rtj^^ in the participation 


1. The reading materials must bo condensed and simplified 
and the number of forms must be reduced. 

2. The slide/tai>es should be reworked to be comprehensible. 

3. Difficulties with the resources should be attended to. 
^4. A method should be sought to improve the relationship 

of the supervisors and the workers and to bolster the 
overall student attitude toward the simulation. 

Specific suggestions as given in the other sections of 
this column by the teachers should be considered carefully 
with a view toward streamlining the module. Improving 
the implementation of the module may greatly enhance its 
effectiveness • 
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Ti^^enty-six percent of the students fe: 
pull things together, with 35^ uncerti 
that it did not. 



Teachers and students have a very nej 
number of forms. In its present forr 
the enthusiasm over the finished proc 
may detract in aJiy form. 
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There were no strong points of the summary 
that were noted. 



Both the teachers and a substantial r 
the use of the summary did not achie'V 
for and that it detracted from the s: 
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Attempts should be made to improve the integration and 
worth of the summary. The number of forms to fill out needs 
to be reduced. 



It is apparent that the summary will need extensive reworkinf^ 
to be a contributory element of the simulation. Care should 
be taken in the process to keep the number of forms to a nimimum 
(it may be that the summary seems anticlimatic especially in 
light of the fact that the students already have completed the 
speakers •) 
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TEACHER PANEL 

1 


!• The instructor's guide vas helpful to 

all teachers • 
2. The in-service training was a valuable 

aid. 


!• The instructor's guide require 
task descriptions. It vas dif 
tion, and to ascertain what to 

2. The frustration level of teach 
failures in the in-service tra 

3* The training session <Jld not m 
what had to be done. 
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too much reading and duplicated 
cult to use» to locate informa- 
:> next, 

1 was high regarding equipment 
ng. 

t teachers totally aware of 


1. Wi*:h regard to the instructors* guide, the teachers 
suggested starting with a summary of the simulation (perhaps 
flow chart), an overview of the evaluation sheet, and a 
glocsary of terms; condensing the rest of the material; and 
reorganizing to eliminate confusion and to provide nore 
positive identification of resources. 

2. In-service training should include instruction regarding 
equipment failures and tool and machine information (includ- 
ing safety factors and how to adjust for the gauge). 
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The project prosented/rcported herein was performed pursuant to a grant 
from tho National Institute of Education, Department of Health, Education, 
and WcJfam. However, the opinions expressed herein do not necessarily 
re fleer the position or policy of the National Institute of Education, 
and no official endorsement the National Institute of Education should 
be inferred. 

Copyright 1973 by The Ohio State University, The Center for Vocational 
and Technical Education, 

Copyright for these materials is claimed only during the period of development, 
test, and evaluation, unless authorization is granted by the National Insti- 
tute 'of education to claim copyright also on the final materials. For infor- 
mation on the status of the copyright claim, contact either the copyright 
proprietor 6r the National Institute of Education, 
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MANUFACTURING PRODUCTION 
"What Do You Know?** 



The purpose of this tes. is to help us find out what you and other students 
like'yorknow about manufacturing production. This test does not xn 
any way affect your grade- 

1 4-^ vv.^ <-oQ<- first fill in the information requested at 
Or„S: -^co-^-\-/ I'^W^ questions on the test the- 

are several short ohrases or statements listed. Pi^ the one 
that blst describe; your answer and circle the letter xn front 
of it For several questi ons special dxrectxons wxll be xnclud 
ed with the questions. Please follow those directxons. 

It you don't know the answer to a question, GUESS. When you 
have completed the test return it to your teacher. 



Thanks for your help. 




vou may turn the page and start as soon as you have completed reading the 



directions. 




MANUFACTURING PRODUCTION 
"What Do You Know?" 

FILL IN THE KOLLOWING TN^'ORMATION : 

Name ' Date 

School City 

Aqe 

Grado v irclc one) 8th 9th other (please specify) 
Sex (•;ircle one) Male Female 

Subject taucjht in th^s class 



STAF<r THE 'VE^T 

1. Which of the following skills or abilities would be beneficial to the 
majority of workers in the manufacturing industry? 

a. Ability to read 

b. Ability to understand and follow directions 

c. Ability to work with one's hands 
All of the above 

2. An individual who performs poorly on the job affects 

a. The quantity and quality of the work produced 

. b. Other workers on the production line 

c. The cost of production 

d. All of the above 

3. Which one of the following would best describe the purpose of a production 
time schedule? 

a. To prevent the wa^te of time and money 

b. To prevent accidents in the plant 

c. To reduce the number of absent employees 

d. To reduce the amount of equipment maintenance needed 
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In manufacturing production many different kinds of tools are used 
to perform various functions. Match the function with the tool 
needed to perform the function by placing the letter of the function 
by the tool. Place only one letter by each tool. 



Function 



Tool 



a. 
b. 
c. 
d. 



shap '.ng 
fastening 
cutting 
grinding 



staple gun 
glue gun 
utility knife 
screwdriver 
scissors 

box and pan brake 
rivet gun 
miter box saw 
tin snips 
Sander 

soldering gun 
handsaw 
squaring shear 



Which of the following things is manufactured? 



a. Coal 

b. Haircut 

c. Candy bar 

d. : None of the above 

Jobs can be thought of as being in "clusters" or grouped as to the fie 
of work. Which one of the following groups of workers does not belong 
to the manufacturing cluster? 



a. Astronomers 

b. Welders 

c. GlassworKers 

d. Machinists 

e. Cabinet makers 

The most, important factor to keep in mind when thinking of shop safety 
is that 

a. Fast workers are usually safer than slow workers 

b. Safety is everyone's responsibility 

c. Machines are impersonal 

d. The safety supervisor is in charge of safety 
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8. The Dandy Gadget Company manufactures a battery powered tie thnt fhislies 
on and off and rotates. The tie is made for use at parties and is siold 

at most department stores. Recently the stores have been complaining that 
something is wrong with the electrical wires in the tie. The group that 
plans production at the company plant has determined that the cause is poor 
workmanship. Whom should they contact to correct the problem in future 
ties that are made? 

a. The quality control supervisor and plant workers 

b. The production coordinator and plant workers 

c. The plant superintendent and the safety supervisor 

d. The plant superintendent and the quality control supervisor 

9. Which of the following items in manufacturing production are affected 
v;hen tools and equpment are not kept in good condition? 



a. Quality of work 

b. Speed of operation 

c. Safety of operation 

d. All of the above 



10. Widgels are manufactured on a tight schedule by the three step process shown 
below: 

Step ^ Step Step Widgels 

A B ^ C ^(Final Product) 

Step A requires four highly skilled and specialized workers. If two of 
them get pneumonia v/hat action should be taken to make sure that widgel 
production stays on its original time schedule? 

a. Hire more temporary specialized workers for step A 

b. Switch workers with different skills from step C to step A 

c. Make the remaining two workers in step A work twice as fast 

d. All of the above 



11. Good production planning is indicated by: 

a. All workers doing the same job at the same time 

h. All workers being busy without waiting time 

c. All workers being satisfied and happy with their jobs 

d. Some hiih quality products being p 'oduced 

12. Which of the following is not a main division of manufacturing? 

a. Administration 

b. Production 

c. Production Planning 

d. Research and Development 

e. Construction 




Which of the following assignments would be a major responsibility of the 
plant maintenance supervisor? 

a. Scheduling production time 

b. supplying tools 

c. Analyzing defects in products 

d. Planning new products 

There arc many different jobs associated with manufacturing production- 
Some of the job titles and job responsibilities are given below. Match the 
job titles with the job responsibilities by placing the letter of a 
single job title by the job responsibility it most closely describes. 
(You will need to use- each job title more than once.) 



Job Titles 

a. Supervisors 

b. Production workers 

c. Inspectors 



Job Responsibilit ies 



Organize and conduct meetings for 
the t^^aining, planning and 
scheduling necesjary for manu- 
fcicturing products 



Have responsibility for setting up 

and operating machines used in 
manufacturing a product 

Examine and test manufactured pro- 
ducts for exactness and neatness 

Assemble things in the manufacturing 

production process by using hand and 
power equipment 

Check manufactured products to make 

sure they are made ^ell enough to 
be sold ^ 

Monitor the production process and 
maintain personnel records 

.Assembling is a manufacturing process that can best be described as: . 

a- Inventing or developing tilings 

b. Putting things together 

c. Breaking things down into component parts 

d. Making things run or operate 



95 




15. The purpose of quality control inspection is: 



a. To make sure that each worker is working on schedule 

1'.^ To make sure that no one is horsing around on the job 

c. To make sure that parts are made according to specifications 

d. To make sure that all working areas are kept clean 

17. Wli:,ch of the following would the plant superintendent be most concerned 
about? 

a. The g(Mieral cleanliness and maintenance of the plant 

b. Supervision of Iho safety pracl-ices of the plant 
Maintaining a h\qh It^-vel of production 

d. Storage of finished products 
«1. Noru* of the above 

18. Wluch ot the following manufacturing workers would be most frequently 
using gauges and measuring devices as the tools of his trade? 

a. The plant superintendent 

b. The production planner 

c. The draftsman 

d. The quality control inspector 
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As soon as you have completed this test, please turn it in to your teacher. 
Thank you. 
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rhe pioject pre5;cnted/reported lierein was performed pursuant to a grant 
from the National Institute of Education, Department of Health, Education, 
and Welfare. However, the opinions expressed herein do not necessarily 
reflect the position or policy of the National Institute of Education, 
and no official t^ndorsement by the National Institute of Education should 
be inferred. 
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proprietor or the National Institute of Education. 
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MANUFACTURilK} PRODUCTION 
WHAT DO YOU LIKE? 



THIS IS NOT A TEST » The purpose of these questions is to 
find out the types of activities and jobs in manufacturing 
production you night enjoy doing* We would also like to 
learn iftaat reasons you have for liking these activities 
and Jobs* 

There are only ik questions to answer* Directions for 
answering are found at the top of the page or are included 
in the question* 

After you have conpleted the questions^ please return this 
booklet to your teacher* Thanks for your help* 




Please begin the questions as soon as you have finished reading 
the above paragraphs* 
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MANUFACTURIMG PRODUCTION 
•lOiat Do You Like?" 

FILL IN THE FOLLOWING INFORMATION: 

Name Date 

School City 

Age 

Grade (circle one) dth 9th other (please specify) 
Sex (circle) Male Fenale 

Subject taught in this class 

Teacher's name 



Turn Lo the next page after you have filled iji the above information ♦ 
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?• Vfhat kinds of experiences or actlviti^rs clc you think people should 
have before they select a Job in the v •» , id of work? Briefly describe 
or list your ideas belov. 



8* Have you ev^r t' ought about how you would go about selecting a Job? 

What eure the luost insportant things that you feel people should consider 
before they sv'^lect or decide ^xpon a Job in the world of work? Briefly 
describe or Ixst your ideas belaw« 




9* Pretend that you have interviewed for several different Jobs in the 
last few days* Yestexday two employers called you and each offered 
you a Job in their organization* Both employers want you to decide 
within two days whether or not you are going to accept their offer • 
Briefly describe below how you would arrive at your decision* 
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Listed below are aooe possible reaaons why It is important 
for people to explore careers ♦ Check / ) the phrasea which 
you think represen I mportant reasons for you* 

you need to decide what kind of life-time Job you 

want before you enter high school 

you are likely to make a viser choice about a job 
if you toow about many different kinds of Jobs 

if you explore many different Jobs you are more 

likely to find one which matches your interest ^ 
abilities and aptitudes 

everyone has to work so everyone must explore 

different occupations 

yhen escploring Jobs it is as important to find out 

about those Jobs you do not like as it is to find 
out about those Jobs you do like 



Pretend that a friend of yours has many hobbies and 
interests which could lead to an occupation* But, this 
friend doesn't know much about possible occupations 
related to these hobbies and interests* 

What should your friend do? (Circle the letters oV as maiiy as 
apply) 

a* Think the problem through with a counselor , 
teacher 9 parents and other interested adults* 

b* Try several part-time Jobs, moving from one to 
another until ox>e seema best* 

c* Plan visits and activities lAich will help in learning 
about occ\;^tions and workers » 

d* Choose any occupation; it will probably agree with 
one of his/her intep^sts* 

e* Put off a choice; sooner or later one occupation 
will look better than the rest* 

f* Don't know* 



BEST COPY AVAiliBi£ 
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During a typical week, about how much ^Jtle do you spend tetlking 
with your friends and other people about ^^ohs and career-rolated 
things you would like to do as an adul'-' v^i^d^ one letter) 

a. no time at all 

b* less than 15 minutes 

c. about 15 to 30 minutes 

d. about 30 to 60 minutes 

e. more theui 60 minutes 

At this point in your life, how import<uit is Lt to you to 
explore potential occupations and gain a bettor understanding 
of the world of work? 

Give reasons for 

a. very important your response. 

b . Jznportant 

c. fairly important 

d. not too important 

e . unimportant 

i would enjoy working where what I did depended on others 
getting their job done and where what I did wets essential 
for others to do their job. 

Yes WTiy? 



no 



Please returii this booklet to your teacher. Thank you. 



APEEajDIX C: 



STUDENT QUESTIONNAIRE - "WHAT DO YOU THINK?" 
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MANUFACTURING HIODUCTION 



WHAT DO YOU THIHK? 
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The project presented/reported herein v;as performed pursuant: to a grant 
from the National Institute of Education, Department cf IU-:?lh, Education, 
and Welfare. However, the opinions expressed herein do necessarily . 
reflect *:he position or t^licy of the Natio.ial Insti.tv*.^ }■ Kdu -ation, and 
no official endorsement by the National Institute of Education should be 
inferred. 

Copyright 1973 by The Ohio State Univer*;ity, The Center fox Vocational and 
Technical Education. 

Copyright for these materials is claijned only during the period of develop- 
ment, test, and evaluation, unless authorization is granted by tlie National 
Institute of Education to claim copyright also on the final materials. For 
information on the status of the copyright claim, contact eit:h3r the copyright 
proprietor or the National Institute of Education. 
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M^UFACTURINC; PRODUCTION 
••WIIAT DO YOU THINK?** 



Now that you havo completed this simulation, the people ;vho developed 
it wouJd like to Cind out what you think about your experience. Your 
ideas will heir to make the simulacion better. Rcmorob^ • '\ V£S IS NOT 
A TKST and your answers vill not be graded. So feel tree to check and 
to say what y^v thin^ abou*" this nimula* . ^n. 

DIRECTION:.: To romploi*-* the questi .^naire, first fi^' \ri the information 
roip; :.».ed at the top of the next paqo. '"Kn there is a list 
of statements which describe a tuclinM idea about the 

sim»ii.ition just completed^ Answer eacrh statement by circling 
the symbol which best matches your actual feeling: 

means the statement agrees with your feeling 

(?) means you 're not sure how you loel obout the 
thing mentioned in the statement 

(-) means the statement does not agree with your feeling 

For several other questions, special di roc-t icii.s will bo 
included with the questions^ Follow those directions* 

Ulion you have completed the questions, please return this 
booklet to your teacher. 

Thanks for your help. 



You may turn the page and start as soon as you have completed reading the 
directions. 



liO 



ERIC 



MAMllFAfTUHING PRODUCTION 
^ ^^^^ THINK?** 

FILL IN THE FOLLOWING INFORMATION: 

Name ^ ^ 

• 1 City 
Srnool ^ 

Acjo 

Grade (circle :v ) ^Hh 9th oth-^r (please spoc-y* 
Sex (circle one) Male Female 

Subject taught in this class . 

Teacher's name - 



START THE QU EgTTONS 

Answer each statement by circling the symbol which best matches your 
.actual feeling: 

( + ) mcansi tho statement agrees with your feeling 

(?) means you 're not sure how you feel about the thing 
mentioned In the statement 

{-) means the statement does not agree with your feeling 



Circle one for 
each statement 



K i learned quite a bit about jobs from the 
simulation. 

2, I learned quite a bit about how to work with 
other people from the simulation. 

3, To me the simulation was boring, 

4, r would recommend the simulation to my friends 



+ ? 



+ ? 



Ill 



circle one for 
Gach statement 



1 would liko t.o <jo throuqh moro simulations 
Iikr this ono» 

G. T would )iavo rather done something else 

du!-ing the time f K'^rked with the simulation. 

7. The simulation helped to answer some of the 
questions T hav^ about jobs. 

8. The simulation too^ too long. 

9. > The simnlatjon was over too soon for me. 

10. Some of the tasks were too complicated or too 
hard for me to do. 

11. The summary helped me to "pull things together." 

12. 1 enjoyed working with other students during 
the simulation. 

13. The activitios that I did in the simulation 
were excitinq to me. 

14. I often had trouble knowinq what to do next 
in the simulation. 

15. This simulation was a good way of getting 
out of class. 

16. There were too many tests and forms to fill out 
with this simulation. 

17. The pretest and posttest were difficult for me. 

18. The simulation preview, activities, and 
summary fit together well. 

19. The preview and the other activities at the 
beginning helped to prepare me for the simulation. 

20. T liked the way I selected my role(s) in the 
simulation. 



+ 
+ 




For the next questions, either write in your answers or check (vO the appropriate 
answers as indicated in the question. 



21. What was your role for roles) in the simulation ''Manufacturfnq Production"? 
(Check all that apply) 



Band Saw O))erator 

Hor inq Machine 

Box Printer 

Electronics Assend'^ler 

Electronic-: '"'-^mpun^'n* Inspector 

Fabrication Irif^pccLor 

General Inspector 

Gluor. TI 

Grinder I 

Hand Assembler 

Hand Cutter ^ 

Hand Cutter II 
^ Hand Driller II 

Hand Packager 

liand Riveter 

Hand Sander 

Lead Former 
' Machine Cleaner 

Machine Holpor 

Maintenance Supervisor 

Marker 



Material Handler 

Metal ^^.il.r i.catinq Inspector 

Packfii:*, i ^' It r 

Paperboard Box Maker 

Pa c V Insp.^ctor 

Pia.i : \K iui.c»ndent 

PortaMc Machine Sander 

Porto"" 1 T 

Prr^':v;^ ' or. Assembler 
Production Coordinator 
Production Supervisor 
Quality Control Supervisor 
Rubber 
Scorer 

Shear Oper:*':or I 
' Sheet Metal Brake Operator 
Sheet Metal I^ayont Man 
Small Parts Assembler 
Wireworker 

Woodworking Machine Operator 



22 • Do you think that you performed well in this role (or roles)? 

Yes, all of the time 
Yes, most of the time 
~~ No, not usually 
No, not at all 

23. List a few reasons why you like or did not like your role (or roles). 



24. Would you choose this role (or roles) if you were going to be in the simulation 
again? 

Yes 
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25 ♦ Describe the one thing which you feel you did best in the simulation and 
one thinq you did least well* Be sure to say why you did well or poorly. 



Best Thing P^^asons Worst Thim i 



26. Wl\at other roles in tbc simulation did you find intoro. ' i 
(Check all that apply.) 



Band Saw Operator 

Boring Machine 

Box Printer 

i:Vctronic^ A3sei;J>ler 

Electronics Component Inspector 

Fcibrication Inspector 

General Inspector 
[ Gluer II 

Grinder I 

Hand Assembler 
[ Hand Cutter I 
' Hand Cutter II 
[ Hand Driller II 
] Hand Packager 

Hand Hivoter 
] Hand Sander 

Lead Former 

. Machine Cleaner 

Machine Helper 
" Maintenance Supervisor 

Marker 



Material Handler 
Metal i\-.p%jcatjnv} Inspector 
Par'kn • - Si-aler 
Parcrbo--'i ^-r • Maker 
Paper 'Products Inspector 
Plant Superintendent 
Portable Machine Sandor 
Porter II 

Production A -sembler 
Production Coordinator 
' Production Supervise.- 
Quality Control Supervisor 
Rubber 
Scorer 

Shear Operator I 
'sheet Metal Brake Op:rator 
' Sheet Metal Layout Man 
' Small Parts Assembor 

Wireworker 
' Woodworking Machine operator 



27. Why do you find this role (or roles) interesting? If you do not find c-nv 
other roles interesting, can you explain why? 



28. Compared to your feeliuyS about the work involved in Manufacturing Production 
before this simulation, how do you feel now? 

I am more interested now 
^ I am less interested now 

I do not feel any different now 
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nxd YOU air.cover a-/ -('W interests by participating in this simulation? 



29. Pxd you 

Yo:-., I •■"•Ri 'low l•>,'->r(''^;^o(l in . 

~ No 

30. Uomo ijoim- of the thinqs you liked nO'M . about th.> ^muim...... and somo uV tUo 

thin<is you lit^od lease abou% the simulation. 



31. Write down some ot >oat ideas on' how the simulation ndghc mada beL-.. . 



As soon as you 
teacher. 



have completed these questions, turn in this bookiet t< your 
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AFIQIDIX D: 



mCHER EVALUATIOir LOG 
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MANUFACTURING HIODUCTION 



mCHER EVAIAJAIIQR LOG 
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The project presented/reported herein was perfomed purmiaat to a 
grant trcm the National Institute of Sducation, Department of Healthy 
Education, and Welfax^. Homver, the opinions expressed herein do 
not necessarily reflect the position or policy of the Rational In- 
stitute of Education, and no offlcleil endorsement Ify the Rational 
Institute of Education should b'^ Inf^srred. 

Cppyrl^t 1973 hy The Cbio State University, The Center for Voca- 
tional and Techniccd Education* 

Copyright for these materials i^i claiined only during the period of 
development, test, and evaluation^ unless authorisation is granted 
by the Rational Institute of Education to claim copy-right also on 
the final materials. For InfoztBatlon on the status of the copyright 
claim, contact either the copyrigbt proprietor or the Rational In- 
stitute of Education. 
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TEACHER EVALUATIOU LOG 



MiMhilf Mile 



MANUFACiURlNC; rKODUC! ION 



ri»aohor Name 

School 

Cfiv 



GjCr^.RAL ^IjtSl'RU^. ': 1 ON s 

This instrument packagt-; is desitjnod to obtaxi; v/cur roactJon'5 related to 
too sinuilaiion module whicb you ^re pilot cestuir, ^os p<t, r cf tae Occupational 
Explorative Progrcim. Vcur close associ.itJcii wivi: the morula* places you in a 
unique posir ion to evaluate overall q^rMitv, to note probieiiis and to offer 
suggeiitions for ruither deveiopmcnl arnVor refineuent. Hence, your c<iadid 
appraisal of rhe module is sought, by ii^ dcvolcpers. Your feedback wiU give 
direction to the revision process, whicn will be rhe next step in developing 
the modulo* 

The package consists of s. veral p'lrts arranged in the order in which they 
should be used. These parts aie described briefly in the table below. Please 
note that while this booklet seems ieiigthv ,each part only requires a short 
amount of time to complete and the parts are spaced out over the classroom life 
of clu- modulo. 



1 nl roduct ion 
to Simulation 



Upon comp let i on 

of the Introduction 



Es t imated 
Time Required 

5-10 minutes 



II, 



Module Preview 



Upon comp let iou of 
Preview 



0 minutes 



(II. Preparation i'hase 



Upon . omp let i v\\ of 
che Fl'.as* 



5-10 minutes 



fV. Part iiM?)at ion 

Phase (i nsk eval- 
uat ion) 



As studontr. i^mplete 
each taslv* 



5-10 minutes 
per task 



Summary Phase 



Upon completion of 
the Phase 



3-5 minutes 



VI. 



(Jeneral Modulo 
Evaluation 



Up;.)n Complex io!i of 
Posttesting 



15-20 minutes 



Part I: TNTRODUCTION TO SIMULATION 
S EMULATION - JlXCITtNG WAY TO LEARN 
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SIMULATION - AN KXCITING WAY TO LEAKN 



Comploto thii; part after your 3tudcntH have s.2cn tho slide presentation im- 
troducing. the idea of simulation, have read the booklet which covers the same 
ideas or have used both the slides and Lookiot together* This part consists 
of several brief questions about the introduction to simulation* To respond, 
circle the letter of the phrase that no..': describes vour answer. Se/oral 
questions will require that you supply a ^hort answer. Space has also been 
provided tor you to write* in iiy coment.^ you havn. You are encoura^ged to do 
so . 



Thanks for your help. 



I, Uow many total .students in your class were introduced to the concept of 
simulation by one or both of thu means described above? 



students 



flow many students used: {count eacl; student only once) 

The booklet only 

The slides only 

The slides first and tl:en the booklet 

The booklet first and then the slides 

Other, please specify 



3. Were the students able to understand concepts pre^^ented in the materials? 

a- Yes, most of the time Comments 
h. Somewhat 

c. No, not much of the time 

4, Was the vocabulary consistent with the maturational level of the students? 



a. Yes, most of it Comments 

b. Some of it 

c- tk>, not much of, it 

5. How would you rate the quality of the illustrations used on the slides and 
m the booklet? (P.nswer both parts of the question.) 



Slides 



'x^okiet 



Comments 



a. Very ^Jood 

b. Good 

c. Average 

d. Poor 

e. Very Poor 



a. Very Good 

b. Good 

c. Average 

d. ioor 

e. Very Poor 
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ovoimII, h«w would you rate the technical quality (appearance, case f-l' ukc, 
.•t. .1 .1! thi- slidf-H and booklet*" (Anawer both p.irt'? of tho quostion.) 
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.li^lo^i B:)oklct Cotu nenLs 

a. V^ry :,ood a. Very Good 
L. Goo J b. Good 

c. Ave:'a<7o c. Average 

d, loor d. Poor 
Vcty Voor Very Pco- 

?• ♦v^*rall, do you foel chat this intio^laction was ?tii?ulating to scudents? 

V»?s, ''ory nuch Common t.s 

lio, not much 

Ill what order would you recoiniuend the use of the slides and the booklet? 
(Choose cniy one-) 

Usr^ both i any order Communis 

b. Use both With tho booklet first 

c. U^;e both with the slides fir^t 

d. U^o the bonklt^t only 
•J* vJ^se the slides only 

f • N'one of the above 

9, Vfculd you reconunond the use cf the slides an^or the booklet to ot>er teachers? 
(Answer both ports of the question*) 

slides Booklet Comments 



a. Yes, wiv^h a. Yes, with minor 
minnr modi- modification 

f ication - 

b. '-q:^, with b. Yes, with major 
:rtajor modi- Modification. 

f ioation 

c. NO/ I would not c. No, I would not 
recommend it recommend it 



Mease write in any other comments/suqgestions you might have in the space 
below, (ir extra space is required, use the back of this page.) 
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PART III - PREPARATION PHASE 



PART III: PREPARATION PHASK 



Complete this part after your students have finished the preparation phase 
of the simulation module. Questions here relate to L>o materials used to pre- 
pare students for participating in the simulation and the actual process of 
getting students into roles. 

To respond/ circle the letter of the choice that best describes your answer 
or how you feel. Some questions will require that you either check ( an 
answer or write in a short response. Space has also been provided for you to 
write any conunents or suggestions you might have. You are encouraged to do so. 

Thanks for your help. 

MATERIALS 

1. In the following chart: describe or name the form of material used (e.g., 
slide tapes, booklets, combination of forms, etc*); specify how many stu- 
dents used the form counting each student only once; rate the technical 
quality of the form; cind rate its overall educational quality or worth. 

Ratings are indicated by placing a check {y/) in the appropriate box in 
the applicable cell. You are encouraged to place comments and/or descrip- 
tions of problems you encountered in the large space provided in each box. 



1 of ro» 


NO. of 

•tudsnta 


1 lUte the technical quality 
(aprcprAfice, of um, 
•tc.) ot th<i form 


J'jiie th* Ov«r«ll Id'icationAl 
VuAllty of the Form 


HlQh 


























Comnents 








Cmmenta 












1 ' ' 


Coanents 


1 1 


Ccwtfn«nta 












1 1 


CcMMnta 


1 1 


Corvnenta 







Were the students* able to understand the concepts presented in the materials? 

a. Yes, most of the time Comments 

b. Somewhat 

c. No, not much of the time 
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Was the vocabularly consistent with the maturational level of the students? 



a^ Yes, nvost of it Conments 

b» Some of it 

c» No, not much of it 

To what extent was the preparation phase integrated with (i.e., how well 
did it fit together with ) the Module Preview? 

a* Very well, integrated Conments 

b* Vfell integrated 

c. Somewhat integrated 

d. Poorly integrated 

e. Very poorly integrated 



ROLE SELECTION PROCESS 

Did the initial role descriptions provide students with enough information 
tor selecting roles? 

a. Yes, the information was adequate Comments 

b. Somewhat 

c. No, the information was inadequate 

If schematic devices (e.g», schedule cards were available to help select 
roles, did students understamd how to use them? 

a. Yes, with little or no help Coirments 

b. Yes, with some help 

c. Yes, with a great deal of help 

d. No 

Not applicable 

Were the students able to independently select themselves into roles? 

a. Yes, with little difficulty Comments 

b. Yes, with some difficulty 

c. No, some teacher assistance 
was necessary 

d. No, extensive teacher assis- 
tance or direction was 
necessary 

If you had to help the students select roles, please describe the nature of 
that assistance (e.g., asked students to draw lots when several wanted the 
same role; explained use of schematic device; etc.) in the space below. 



9. 



Overall, was the role selection process described in the nodule an effec- 
tive way of getting students into roles? 



a. Yes, it was effective 



Couunents 



10. 



b. Somewhat effective 

c. No, it was ineffective 

Can you suggest other ways in which this process could occur? 
a. Yes, I would suggest 



b* No, the process was effective 

se write in any other comments/suggestions you might have in the space below. 
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PART V: SUMMARY PHASE 
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PART V: SUMMARY PIIAS'. 



Complete this part when your students complete the "Sunwary" phase of the 
rxMc. To ro.spond, simply circle the letter beside the phrase that best de- 
scribes your answer or supply the requested information, .Sl,ace has also been 
provided for you to wLite in any comments/suggestions you may have. 

Thanks for your help. 

1- tow effective was the "Summary" phase in providing a reasonable culimina- 
tion to the simulation experience? 

a. Very effective Comments 

b. Somewhat effective ~ ^ 

c. Not effective 

2, Was the "Summary" phase well integrated with the immediately preceding 
activities or ^lasks? 

^' Comments 

b. Somewhat 

c. No 

3. Did you have to modify or expand upon the "Summary"? 
a. yes, I did the following % 



4, 



No 



now effective was the "Summary" phase in helping students learn about occu- 
pational roles performed by others in the simulation? 

a, very effective Comments 
b* Somewhat effective ^ 
c. Not effective 

HOW effective was the "Summary" phase in helping students learn about tools 
processes and working conditions associated with that part of the world of 
work simulated in the module? 

a. Very effective Comments 
b* Sonewhat effective "~ ~ 

c. Not effective 
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6. How useful do you feel the "Summary" phase would be in helping students 



identify and select alternatives for further action related to other 
occupational exploration activities? 

a. Very useful Comments 

b. Somewhat useful 

c. Not useful 

Please write in any other comments/suggestions that you might have in the space 
below. 
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Part VI: GENERAL MODULE EVALUATION 
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Part VI: GENERAL MODULE EVALUATION 



These questions should be answered as soon ai5 possible after the 
pilot test of rhis module has been completed, i.e., after the 
post tests have been given. 

The questions are divided into several sections. The first soc- 
ti"'!'; deals with general background characterirtics of students and 
touchers. This inforration will be used solely for the purpose of 
.^riling the studon* "^nd teachers who partici^oated in the pilot 
^^-^t of this Tiodulo. Subr^equent sections will deal with implementa- 
^\ li problems^ your perceptions of the quolity of the materials, etc. 

Fill in the information requested at the top of the questions and 
then answer each question by circling the letter in front of the phrase 
that best descrJ^bes your answer, unless given other specific directions 
In the question. Space has also been provided for you to write in any 
coiranents/suggestions you might have. You are encouraged to do so. 

Fill in the following information 

Teacher Name 



School 

City 

Date ^ 

TEACHER BACKG.vOUND 



1. What is your sex? 

a. Male 

b. Female 

2. Including this year, approximately how many years of teaching 
experience do you have? 

a. This is my first year 

b. 2-4 years 

c. 4-6 years 

d. 6-8 years 

e. 8 or more years 
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In what kind of group setting (e.g.^ English classroom^ math 
classroom, students from study hall, students from a guidance 
group, etc.) and at what grade level did you introduce this 
singulation? 

a. Group Setting (please specify) 

b. Grade Level (please specify) 

Have you had any previous experience with simulation as an 
instructional technique? 

a. Yes, as a teacher 

b. Yes, as an observer 

c. Yes/ as w» participant 

d. Mo 



If you answered yes to question 4, briefly describe the nature 

and extent of your previous experiences with simulation. If 

your response to question 4 was 'No' please proceed to question 6* 

a. My previous experiences with simulation include ^ 



Which of the following statements best describes your reasons for 
participating in the pilot test of this simulation module? 

a. To try out new ways of organizing instruction for students 

b. Interest in Career Education 

c. Thought material was of value for students 

d. General interest or curiosity 

e. I was requested to participate 

f» Other, or some combination of the above (please specify) 



7. How many students participated in the total simulation? (Include 
only thost* students who were involved in the module and received 
both tuo pre and posttests) • 

Students Participating 

x'^, t)f the students in question 1, how many wore male ^nd how many 
wore female? 

Males l^o^T.c^los 



Mow were ^^u^ s selected to particii^-'o in the simulation? 

0. Most of the students were volunteers from the class 

b. The clasS/ rath*^ r than the students, was volunteered 

c- Student volunteers from a study hall 

d. Other/ please specify 



10. If you had volunteer students participating in the simulation 
which of the following reasons best describes your perception 
of why they participated. If you did not have any volunteer 
students please proceed to Question 11. 

a. Interest in trying something new 

b. Interest: in particular area simulated 

c. Interest in careers 

d. Interest in just getting out of class or study hall 

e. Other, or some combination of the above (please specify) 



f. 1 can't really guess at the reason (s) 

11. Indicate any special characteristics of this class, e.g,, many 
slow reader.*? in class; many students with exceptionally good 
verbal skills; etc., which may bias the results of the pilot 
test of this module. Also describe how you feel the results 
will be biased by these characteristics. 

a. Characteristics Biases Produced 



b- No special characteristics 



^ 1 IS 



12. In qeneralr how well did the transition from phase to phase of 
^hc ttK)dulo proceed? 

u. Very well Coniments 

b. Wi^ll 

c. About average 

d. Poorly 
Very poorly 

l^. there any additions, deletions or changes in the order of 

nodule parts that you f^*el should bo mad»? 

>\ Y'M, niak^'* ^olXowinq changes 



b. No changes are necessary 



ADEQUACY OF MATERIALS 

14. In qenoral, were the directions in the module clear enough for 
students to understand what was expected of them? 



Comments 



a. Yes 

b . Somewhat 

c. No 

15. In general, was the vocabulary of the module consistent with the 
maturational level of the students in the simulation? 

a. Yes 

b. Somewhat 

c . No 

K . Vo you feel that the knowledge (What do you knov;?) and the atti- 
tude (What do you like?) tests were adequate measures of the 
material contained in the module? (Answer both parts of the 
question, ) 

i Cnowledge Test Comments Attitude Test Comments 

a. Yes a. Yes 

b. Somewhat b. Somewha^t 

c. No c- No 
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1 To what extent was the knowledge test difficult for students? 

v\. very difficult Consents 

Difficult 
c. About average 
^i. Easy 

Very easy 



^2^U£^L 0^ NODULE 

\ how well did the m-service training prepare you to work with 
*rhxs module?' 

\\ U Comments 

^oinowhat 
J . :\5orly 
e- Very poorly 



Did Che in-seirvice training provide you with a general understanding 
of your role in the 'nodule implementation? 

a. Yes Comments 
b- Somewhat 
c* No 



20* Vfliile working with this module, did ^^ou have to allot (or spend) more 
time than you normally would for preparation (exclude the time spent 
in in-service training)? 

a. . Yes, specify additional time Comments 

in hours 

b. Some extra time was necessary 

c. No extra time was necessary 

:^1. !bw sizeable was the job of managing/coordinating this simulation 
n^odulo ior youV 

a. Very sizcciblo Comnents 

b. About average 

c. Not sizeable 
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STUDENT PARTICIPATION AND LEARNING 

22. Did your students experience problems wi.j* the reading level of this 
modulo? 

a. Yes Comments 

" — — — Sonfewha^t ~~ ~ " 

c* No 

23. To what extent do you feel students were receptive (interested in, 
excited by) to simulation as a way of learning? 

a. Very receptive Coitinents 

b. Receptive 

c. About average 

d. Non- receptive 

e. Vary non-rec<^rtive 

7^. To what extent do you feel that students were receptive (interested 
in, excited by) to the content of this particular module? 

a. Very receptive Comments 

b* Receptive 

c. About average 

d. Non-receptive 

e. Very non-receptive 

25* Was there any chemge in student interest or motivation as they 
progressed through the module? 



a. Yes, interest changed as follows. 



b. Somewhat 

c. No 

26. Do you feel that -this module reinforced or helped to build the 
student's ability to make decisions? 

a. Yes ' Comments 

b. Somewhat 
c* No 

d. Don't know 

27. In your judgment, how much did students learn about the process 
of simulation and about the content of the module? (Answer both 
parts of the question) 

Simulation Process Commftnts Module Content Comments 

a. Very Much a. Very Much 

b. Much b* Much 

c* An average cimount c. An average amount 

d. Little d. Little 

e. Very little e. Very little 
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BEST COPY AVAIIABLE ^t^i^ 



OVERALL PERCEPTIONS AND RECOMMENDATIONS 



^28-. — i-n'-general-was-.this_mpjiule_ — 

a. Exciting to students. Consents 

b. About average for 
students. 

c. Boring to students. 

29. in general did this module change the working relationships 

(personal interactions) between you and participating students? 

a. YeS/ relationship changed as follows ^ 



b» Somewhat 
c. No 



30» Are there any students or grovps of students (e.g., some students 
may have difficulty working in small self-directed groups) that 
you feel would have difficulty participating in simulated types 
of experiences? 

a. YeS/ (please specify) 
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b. No 

31. For what grades would you consider this module to be appropriate? 
(Circle as many as apply) . 

a. 10th or higher* Comments 

b. 9 th 

c. 8th 

d* 7th or lower 

c. Other, please specify 

32. Overall, how would you rate the quality of this module? 

a. Very good Comments 

b. Good 

c. Average 

d. Poor 

e. Very Poor 
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33. If po:.;sible, would you use this module with students again? 
a. YeS/ with no modification Coirments 



bT— VesT-wi-th-minor-modi^cati^ons 

c. Yes, with major modifications 

d. No 

34. Would you recommend this module to other teachers? 
a. Yes Comments 



b. No 



COMMENTS AND/OR SUGGESTIONS FOR REVISION 



Add cis many comments and/or suggestions for revision of the module as you 
might have- 



Thank you for your help in evaluating this simulation module. 
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